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„e« .wo se„.e«s. ..e .ep o, a*. Cec. noaes Co U, sue. .a, eaoK 

..ec. node .cs „o. v.,a,e p— „ea ,ir. a„. CecMegr. — s is se. for* on pa.e „u„.r 3, 

„„s,raia.s is se, fo„h in *e Us. senience of .he f,rs. (pa..iai) paragraph on page number 2. 
5 The above aigorirhm is also se. form in Figure 1 of fl,e enclosed documen.. 
, Liicewise a. ieas. .he remaining independen. ciaims are my disclosed in *e enclosed 



document. 
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'O ^ ^ jS^ibNING LDPC CODES USING BIT-FILXING 

HOV 2 A 2DI13 v. 
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650 Heiry Road, San Jose, OA 95120-6099 NOV 2 8 2003 

email: {caiap«llo,dinodha,5ridhar}ealmaden.ibm.coro TeChnOlOgy Center 2100 

July 31, 2000 

ABSTRACT: Bipartite graphs of information bits and parity checks arise a. Tarner graphs 
corresponding to low density parity check codes. Given graph parameter, sud. .s. ihe lua^^ 
of checks, the ma:dmma check-degree, the bit-degree, and the girth, we — f ^ ^^^^ 
of constructing bipartite graphs with the largest nun»ber of bits, that i. the lughest «te^ 
We propose a simple-toimplement heuristic BiT-FlLUNO algorithm for th^ P^^^^ 
benlmark. our algorithm yields better or comparable rate codes to those pubhshod oy MacB.y 

11]. 



Keywords: LDPC codes, Callage: codes, error correction codes. Tanner graph, pi 
matrix, code deagn, iterative decoding 



1. Intpoductioa 

Bi«rtiU =»h. .f i»fom.tton I* ««i P-it, c/«o(..«« -T^er graphs cor :«p<«»JioS 

.„ ch«k codes. The length of .he s»^es. cycle to a graph « 

Wh^Tdeoodtog low d««i.5r parity check (IDPC) code, usrng the s»m.p,odu t d«od, .^ 

""^^ ' , . j^H„, itatatkjlB of the algorithm ta ptopottiontl I J the giith 
Jgorithm, the number of independent Iterations oim «is it is important to 

of the lanner graph correeponding to the cod« (2, I^ma C. ^ ^^ ''^f^ 
.„n.«uct bipartite graphs of bit. and checks that have large guth. Conversely. for^J« S 
^ ™.d h^ to the rate of the assocUted code, that U, the , „ 

A LDPC code can be describe! h, .playing it. p«i.y check matiuc B. " 
htaar, matrix such that its row. correspond to checks and it. -^'^'^^^'^^ ^^^^ 
Oi J a parity check matrix fl. w, can define it. .»»ciated ^f j^-^l' „ 

a bipartite gr^>h with ,n+ n vertice. V = the LDic Tcde 

and 1 < J < 1. there b «. edge (i.m + j) m B « K^j = 1- The rate oi 
correq>ondingtoirian/(in + n). , _„,„„»:,. eombina^ 

In this paper, are interests! in the Mowing design problem ■» ~™ 
U.Z 7J^> ^ «e pven po=ti,e integers a, I, « . and m; -her. J i. <«.mred to be v.^- 
ZZ, coTtrucIg a . X . parity ch^ matr. H -i^t^-; ^ ^ 

(that is, the largest possible number of .column, n) Kich that H has exactly 
column, at most J one. to each row, and G(H) ha. girth J. for 4e 

in tL paper, w, propo. a .im^e-t^implement ^-"-^ 
abo. problem. Our algorithm l«s a comput-lonal c^^y ^ ^^'^J^'^J',^, „ 
can be implem«.t.d ^ 0(tm>) operation.). As ' '>^'*'^;'^ ^ 
comparable rate, to some of the Wahest rate codes found by MacKay [l). t 
,^ be adapted to the important «xed rate case -h», giv«. the number of P»"" 
IHr^Iumber information bit. », the check degree and bit degree a, we an= mterested m 

t^rlw ^iou. approaches to constructing tDPC codes. U hi. original 
monograph, GalUger P, Appendix] gave a. algorithm for the W rate -■^;<^-^; 
vario^ algebraic constructions, also in 6x.d rate «tti«g, see (3, 4, 5, 6). Fbr f^"^ 
de*. ofpapl-s "1th girth 6 udng m^ly random construction., «e, for ex^nple, [Ml- -r 
deriS of PeP^ conductions «.d linear programmmg, «. PI- 

2. The BiT-PlLLiNG Algorithm 
2.1. The Idea 

Suppose we have already constructed a matrix ff with n column., n > 0, that satisfie. all 
.h.c:ril We now Jwhow to addC+lMhcolumntoH. We think o(t.e.ew column 
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1: setn = 0, A=H, and C7i = * 
2: foiceH,8etw«ght(c) = 0andjV; = ^ 

3: do{ 

5: seti = 0, Crx = ^, andir = * 
6: do { 

7; compute Fo = A\U | 

8: if(Fo#^){ " ^ 

a. choose c* from FoswxordingtQ some heuriBtic 

10- Vc G CTi, update = U {c} aad update A.. = U CT^ 

upd Jir. = U {c«}. = U V(,/3)-x(0. degreeCO. «d A 

11: } 
12: t = i + 1 

13: > while ((» < a) and (Fq 9^ ^)) 
14: n = n + 1 
15: } while ((i = o) (Fo # <^)) 



Figure 1: The Bit-Filling Algorithm. 
.......... ...^=.e«„o.....^^ 

I„ Figure 1. w, p»«n. ^^Hthrn b,^ «n th. 'f^^^'^T^^ d«ck mt:!:.. 

. f>,^n in the beeinning of the next iteration, line * awus f 

matrix iif. Each iteration of the inner do wni.e lu y 

tothesetU"!- ^^^v — fifrfT"! assc dated ^ith 

lt,d«=nb.*.P««=<i-."'>'lP'"«W-^=*''»^''^;'''° = 27X pr.=».: of 
th. «..HX H. Th, b,p«tit. P.ph G » d«l and n « ^ -^"^ 
^d»g (n + D-th col™» of fi is Bk. adding (n + Hh « „od, « 0^ c» . 

^ Aough, of « th, «. of ch«b .ha. have been ""f J7«'^'°J^ "J^ i,, tte 
that i. b«ng added. Th. pro«.. of >ddi.« a check c* to tf, " ^ , _ „^ 

+ l)-th W to C-th check. This new edge must not create m cyde- •«'S'" - 
«n.ll.r; « no. describe a test to enforce this constr^l- 

H,r a Jheck 1 < c < m, let V, denote the set aU ch«:ks ^''J^ 
worts, jV, is the set of ell check node, that ate »>^7 two d,st^t «ig» 
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j > 2, define 



u ^- 



. . .V n«,af>, 2 from every check in C/-1 to some Check in C^i. Now adding 
Intuitively. Hxere . a path of len^h ^ ^"^^^^^ So. if - i, in 17. 

' "jL^^rcydt H::^^^^^^^^^^^ - a^ia the check, i. 

then we are guaxaateed a 4-cyae. nence, . . , ^„ -very check in Uj tc so:ue 

Conti^ in thiB fashion, there ^ a path of leng^ ft- - ^ ^^^^ ^ 
check in C7._,. and, hence, there is a path of length at most 2j 2 trom ir j 

L ieck L V,. Thus. adc^S - ch-^ in to 17. will create a cycle cf U^g^^h 2; 
Hence, to satisfy the girth constraint, we should avoid adding checks tb, set 

cr= U 

l<?<(8/2)-» 

to U\. 

Let • • 

A = {c e 1ml : degree < &} 

tt 1 U ^ .o t;. without vioUtfcg th, 0, th. cl»cM.r« conetr^t » 

?b = A\I7. 

' I. V f^oTT, we brieflv discuss an efficient implementation of (2). 

update U in line 10 than recomputing it afresh using Speaticauy, 
check c to C7,. then we set !7,(c) = {o} and, for 2 < i < (5/2) - L compute 

I7,.(c)= U 

and compute 

l<J<(ff/2)-l 

Finally, update £7 using 17 ^ C7 U V^^/2)-\{c). 
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2.2, Main Heuristic 



' The moat crucial step of the Bl^-FiLLiNO algorithm is the choice of the check c 6 Fo 
• ^^TfZ i ZZ. choice of c* from Fo is valid. Judicious selection of ^ . 

ime 9 of Figure 1 wmi y ^ back-traxdung and recursion, we can Iry 

crucial to achieving high-rate codes. '^<fy^ ' ^ry every future choice, etc., ttus 
every possible choice, a.d then «condi '^^l^t T^Z^, .e often wia. we coUd 
aear<3ung through an eictremely large tree P^^'^^^ ^ computationaUy 

Uve life in this way! Unfortunately, while optmial, such exhaustive search P 

Also a large number of choices actually lead Xo isomorphic graphs ax d are thus 
mfeasible. Also, a iw^c ♦« nick one seemingly effective, and 

equiv^ent from our perspective. The role of heuristics ^ *° P^^;™^^^ 
A computationally feasible, path through this gargantuan ree P^^^^^ . ^^^^ 

we let our .oice of ^ ^ ^ ^ a^^^^^^ - -k 

graph G as fcomojeneow as possible, that IS, irom wi« f -rAnH eavallv dense. 

Also, from the perspective of the (n + l^h bit that is bemg , 

the check that is least used. and. hence, provides better error protection- We 

choice precise. 

A* a first try. we look at the following subset of Fq 

Fi = {ci 6 Fo : Vca 6 Fo, degree(ci) < degree(c2)> 

1.^,1,0 !« I? As a FiRST-OnDfia heuristic, we .nay simply 
namely, the set of smallest degree checks m Fg. As a tlRSX wi^u fu^t- 
chooJ c- to be any element of F,. We shall refer to these heuristic as 1-h meama 
:rrhomogeneity We will show in Section 3 that this first-order heuristic already yields qute 

''^l. F. is smaller than Fo, it does not uniquely determine a ^^^^ 
narroravalLble choices, we apped once more to homogeneity. The idea is ^ ■ .ook -.he 
degrees of checks that are two edges away from the checks in Fi- We wnte 



= (c,eFi:Vc,eF„ E degree(c')< ^ degree(c'') . 



Where V^) is as m (4). Now. we may try selecting a check from F. Howp on ea^-- 
I . possLle that F. has mere than one .ement. Thus, to ^her 

we Jay look at the degrees of chec^ that are four edges away from ^^^^^ ^ ^^^^^J^^ 

continue in this fashion. The basic idea can now be described 

The idea ^ to progressively look at larger «id larger -^hborhoods of a fe^W^^^ 

to distinguish them; we refer to this heuristic ^ «c-h" for complete-homogene^y. The ^ 

. endwL" loop Unates when the set of choices reduces to a set of -J^^*^^ ^ 
till the set of choL does not further reduce in cardinality. The set m bne 9H « a s.- of 



^, ^ since, in this the ^ ^«Xr:r^de cannot ^her dial^^h 
in F, \ E,. FUrthemore, since, using homogene;^ " " J^ce fro« this set. SpecificaUy, we 
between the elements of \ E^, we «mply make some choice from 
^ect the lericographically smaUest check from tto set. 



9A: set J = 0, -So = -Fb 

9B: Vc 6 Fo, I7i(c) = {c> 

9C: while ((IFjl > 1) and (Bj - F,)) { 

9E- Vc 6 Fi-i, compute Wi[c) = 5:=»6v-,(c) 

'f: compute F, = 6 F,-. : Vc. € F,-t. ^yC^.) < ^^(c^;} 

90- Vc € Fj, compute Vi+i(c) using (4) 

9H: compute Ej = {c 6 F, : Vi+i(c) V,(c)} 

91: } endwhile 

93: if(|Fil = l) 

9K; select from F^- 

9L: else 

9M: select c* fcom F,* \ 

I9N: endif 



Figure 2: The Vh" heuristic for selecting the check c" from Fo- Thi. 
heuristic is meant to replace line 9 in Figure 1. 



S. Results and Discussion 



yirid. higher rate cod«, Mid m 2 ««3,''U.n« better, .tyidd, 7.™ 7 

(«x«. rate, «^ ^h) S, far - 
* ^ on J nuniber of p»i.y d«da, d»clr degree., '^ '^^-^^ „, 

. , i: L j-.-^ ;« Gallaaer [21. is riven the number of panty ciecs 3i« . 
interesting problem, first considered m ^aUager Li, P constructions 
the check degree 6, and bit degree a, ma«mi« the girth ff. For vanous alge 
of fixed rate, high girth graphs, see [3,-4]. 
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90r"l229 lS89 

3 u-' 1515 1636 

4 222 IMS 2628 2762 
4 300 4096 4807 5499 
4 444 3584 10839 11088 
3 60 492 437 485 
3 62 494 464 483 

3 90 998 970 1087 

4 282 4376_J293_«31_ 



^«>t in Kgur. 2. Also, for a co<to, - r.^««i J 

unrestricted * 

ImtVa Out •l»Mitl™c»n be adapted 
prth B *. elS0ri«H» find, (-P. ^ (^^.a,, doin; . 

All ,h. GOeje. code. «.d in W ^P^^ ^ ^ .Ugonto » 

..U » in>p»™ the pe^^;^;^' ^t^^T.!... ^ .o.S. 
m = 48 and 102, our algorithm is able to unp 

,^ ^ N T« analyze the computetional conplaity of the 

H^.. 3.3 (coraput^tion^ ^jr^^st^par^neter., we con.de: t:.e foUovins 
problem of desigmixg high rate codes sat^tymg & 
decision problem. 

GWTH&Bl-DBORBB v „ ^ a^id n axe positive integers aoid 5 « e.r«i. 

mincer (a.&,5.m,n) where a. 1^, ^ ^ ^a, exactly a ^^e» m each 

Qw^twa; Doe, there exist a m X n bmary matru « 



U »c« 6 »«. in =«h rcw, «d GW 1... gM* 

ta 0(m") op««i«». Sine, th, loop » .««ed " !" '^'d^ . . . wWl.- 1«P i- ta« 
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